Research and Development Office

Selected Development Project

Project Title

Developing a New Class of Item Response Theory Models for Ipsative Tests with Forced-Choice Items


Principal Investigator	Prof Wang, Wen Chung

Area of Research Project

Psychological Studies

Project Period

From 01/2014 To 12/2015

Objectives

To develop a new class of IRT models for ipsative tests. To develop parameter estimation procedures and evaluate their performance so as to provide practitioners with clear guidelines for ipsative test design. To develop methods for assessment of differential statement function and model-data fit, and evaluate their performance To demonstrate the implication and applications of the new class of IRT models

Methods Used

Developing a new class of IRT models to cope with complicated ipsative test, including multiple statements, model invariance, etc.
Investigating technical and practical issues through simulation studies
Demonstration the implications and applications of new models with empirical analysis .

Summary of Findings

Establishment of new IRT models for ipsative tests;
Advancing methods related to parameter estimation, measurement invariance, computerized adaptive testing for ipsative tests;
Development new and computerized ipsative tests for education, psychology and industry usage.

Impact

Fill in the missing part of IRT models for the ipsative test;
Correct the fundamental questions/errors embedded in previous IRT models for ipsative tests;
Initiate a new research lines;
Provide guidelines for practitioners to design and apply computerized adaptive ipsative tests for career guidance and personnel selection.

Output

Chen, C.-W., & Wang, W.-C. (2013, April). Item response theory models for ipsative tests. Paper presented at the annual meeting of National Council on Measurement in Education, San Francisco, USA.
Chen, C.-W., & Wang, W.-C. (2014, April). Detecting differential statement functioning in ipsative tests using the logistic regression method. Paper presented at the annual meeting of National Council on Measurement in Education, Philadelphia, USA.
Qiu, X.-L., & Wang, W.-C. (2014, April). Computerized adaptive testing for forced-choice ipsative items. Paper presented at the annual meeting of the American Educational Research Association, Philadelphia, USA.

Biography of Principal Investigator

Professor WANG obtained a PhD degree from University of California at Berkeley (UCB) in 1994. He was installed in the 2014 Class of the American Educational Research Association (AERA) Fellows. The AERA Fellows Program honors education researchers who have substantial research accomplishments, conveys the association’s commitment to excellence in research and emphasizes the importance of sustaining excellent research in the field.

He received President’s Award for Outstanding Performance in Research from HKIEd in 2012, and Research Excellence Awards from National Science Council and National Chung Cheng University, and the Mu-Dou Award（木鐸獎）for his contribution to education. He is a Fulbright grantee in 2005 and visiting professor of University of California at Berkeley in 2005 and 2007.

Professor Wang is an associate editor of Applied Psychological Meaurement, and editoral board member of several journals, inclduing Asia Pacific Journal of Educational Development, Bulletin of Educational Psychology, Chinese Journal of Psychology, Contemporary Educational Research, Educational and Psychological Measurement (2006-2010), International Journal of Quantitative Research in Education, Journal of Computerized Adaptive Testing, Journal of Educational Measurement, Journal of Educational Research and Development, and Taiwan Journal of Sports Scholarly Research.

Professor WANG has published more than 170 refereed journal articles and several books and book chapters. He has been an anonymous reviewer for many journals, as well as an external proposal reviewer for National Science Foundation (USA), National Science Council (Taiwan), National Institute of Education (Singapore), and University Grants Committee (Hong Kong).

Since joining HKIEd in 2008, he has received 5 GRF grants (principal investigator; PI), 1 PPRF grant (PI), 1 GRF project (co-investigator; Co-I) and 1 project from the Economic & Social Research Council / Research Grants Council Joint Research Scheme (Co-I).

Funding Source

General Research Fund